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Abstract. A sequence of k- uniform hypergraphs Hi, H2, ... is said to converge if the homomor- 
phism densities t(F, Hi), t(F, H2), ■ ■ ■ converge for every fc-uniform hypergraph F. Lovasz and 
, Szegedy showed that every convergent sequence of graphs has a limit in the form of a symmet- 

ric measurable function W : [0, l] 2 — > [0,1] that determines all limits of subgraph densities. For 
J hypergraphs, analogous limits W: [0, 1] 2 '~ 2 -> [0,1] were constructed by Elek and Szegedy using 

ultraproducts. 

f*) i We give a new ultraproduct-free construction of hypergraph limits as well as a colored general- 

ization. Our proof follows the original approach of Lovasz and Szegedy, with the key ingredients 
being a weak Frieze-Kannan type regularity lemma and the Martingale Convergence Theorem. 
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1. Introduction 

One of the starting points in the theory of dense graph limits is the seminal paper by Lovasz and 
Szegedy [9J where they constructed limit objects for convergent sequences of dense graphs. The 
subject has grown enormously since then with many exciting developments (see Lovasz's recent 
monograph [7]). 

For any two graphs F and G, let hom(i ? , G) denote the number of homomorphism from F to G, 
i.e., maps V{F) — > V(G) that carry every edge of F to an edge of G. The homomorphism density 
t(F, G) is defined to be the probability that a random V(F) —> V(G) is a homomorphism, i.e., 

hom(F, G) 



> 

m 

VO i t(F, G) : 



A sequence of graphs G\, G2, ... is said to converge if the sequence t(F, G\),t(F, G2), ■ ■ ■ converges 
for every graph F. Convergent sequences of graphs were defined and studied in [H [2]. The main 
result of Lovasz and Szegedy [9] is that for every convergent sequence of graphs there is a limit 
object in the form of a graphon, which is a symmetric measurable function W : [0, l] 2 — > [0, 1] (here 
symmetric means that W(x,y) = W(y,x)) such that t(F,G n ) — > t{F,W) as n — >■ 00 for all graphs 
F. Here t(F, W) is defined by 

t(F, W) := / \\ W(x{, Xj) dx\dx2 ■ ■ ■ dx\ V r F \\ 

/rn 1 1 v(f) J -- L 

The natural extension of these limits to hypergraphs was considered by Elek and Szegedy [3]. 
They constructed using ultraproducts an "ultralimit hypergraph" for any sequence of hypergraphs, 
and established a correspondence principle which enabled them to convert statements about finite 
hypergraphs, such as hypergraph regularity and removal lemmas [6| II H [T2]. to measure-theoretic 
claims about ultralimit spaces. One of the consequences of their work is the existence of a limit 
object in the form of a measurable functions W : [0, l] 2 ~ 2 — > [0, 1] for any convergent sequence of 
fc-uniform hypergraphs. 

In this paper we provide an ultraproduct-free construction of hypergraph limits. Our approach 
follows the original approach of Lovasz and Szegedy, with the key ingredients being a weak Frieze- 
Kannan [5] type regularity lemma and the Martingale Convergence Theorem. 
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Convergence and limit object. For any /c-uniform hypergraphs F and H, let hom(F, H) denote 
the number of homomorphisms from F to H, i.e., maps V(F) — > V{H) that carry every edge of 

F to an edge of H. Define t(F, H) := hom(F, G)/ \V(G)\ lV(F]l . This is the probability that a 
random map V(F) — > V{H) is a homomorphism. We say that a sequence of /c-uniform hypergraphs 
Hi, H%, . . . converges if t(F, Hi),t(F, H2), ■ ■ ■ converges for every /c-uniform hypergraph F. 

For any positive integer n, define [n] := {1,2, ... ,n}. For any set A, define r{A) to be the 
collection of all nonempty subsets of A, and r < (A) to be collection of all nonempty proper subsets 
of A. More generally, let r{A, m) denote the collection of all nonempty subsets of A of size at most 
m. So for instance, r<([n]) = r([n],n — 1). 

Any permutation a of a set A induces a permutation on r(A,m). We say that a function 
W : [0, l] r ([ fc l' ,n ) — )• [0, 1] is symmetric if it remains invariant under any permutation of the coordi- 
nates induced by any permutation of [k]. For example, W: [0, l] r <([ 3 l) — > [0,1] being symmetric 
means that 

for any permutation a of [3]. Here we used the shorthand xi to mean x^ and x%j to mean x^jy 

Definition 1.1. A k-uniform hypergraphon is a symmetric measurable function W: [0, l] r <(H) — > 
[0,1]. 

Example 1.2. A 3-uniform hypergraphon is a measurable function W: [0, l] 6 — > [0,1] satisfying 
the symmetry condition (11. ip . 

For any /c-uniform hypergraph and hypergraphon W, define the homomorphism density by 



t{F,W):= [ [] W(x r<(A) )dx r 



Our convention throughout the paper is that x_4 = [xa '■ A € ^4) is a vector whose coordinates 
are indexed by a collection A of sets. For any B Q A we write xg = (ig : B £ B) to mean the 
restriction of the vector to the coordinates indexed by B. 

(3) 

Example 1.3. If K\ is the complete 3-uniform hypergraph on 4 vertices and W is a 3-uniform 
hypergraphon, then 

t{Kf',W) = I W{xi,X2,Xz,Xi2,Xi3,X2z)W{xi,X 2 ,X 4 ,Xi2,Xi i ,X2i)W( K Xi,X3,X i ,Xi3,Xi i ,XM)- 
J [0,1] 10 

■ W(X2, X3, X4, X23, X2A, X34) dx\dx2dxj,dx^dx\2dx\3dx\Adx2'idx2A_dxj,A. 

Every /c-uniform hypergraph H can be represented as a /c-uniform hypergraphon W H as follows: 
divide [0,1] into equal-length intervals {Ji, 1%, . . . , I\v(H)\ }• Define 

_ 1 1 if 6 I ai for i = 1, . . . , k and {oi, a 2 , . . . , a k } is an edge of F, 
1 otherwise. 

In particular, W H only depends on the first k coordinates. It can be alternatively described as 
taking the adjacency array of H and then adding 2 k — 2 — k extra free coordinates. It is not hard 
to see that t(F, H) = t(F, W H ) for every /c-uniform hypergraph F. 

The main purpose of this paper is to give a new proof of the following result of Elek and 
Szegedy [H Thm. 7] on the existence of hypergraph limits. 

Theorem 1.4. For every convergent sequence of k-uniform hypergraphs H\, H2, ■ ■ ■ , there exists a 
k-uniform hypergraphon W so that t(F, H n ) — > t(F, W) as n — > 00 for every k-uniform hypergraph 
F. 
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It may initially seem somewhat strange that we need 6 coordinates to describe the limit of 
3-uniform hypergraphs, whereas every 3-unifbrm hypergraph can be described in terms of a 3- 
dimensional adjacency array. These extra dimensions do not arise for limits of graphs, but they 
are essential for hypergraphs. Here is a standard example illustrating why functions of the form 
[0, l] 3 — ► [0, 1] cannot capture the richness of 3-uniform hypergraph limits. Take G n ~ G(n, 1/2) 
to be a sequence of graphs on n vertices, where each edge is generated with probability 1/2, and 
let H n be the 3-uniform hypergraph whose edges are the triangles of G n . Then with probability 
one, t(F,H n ) -> 2- £2 ( F ) for every 3-uniform hypergraph F, where e2{F) is the number of pairs 
of vertices of F that are contained in some edge of F. The limit of H n is different from, say, 
the constant hypergraphon 1/2, which is the limit of a sequence of 3-uniform hypergraphs where 
every triple of vertices is taken to be an edge independently with probability 1/2. To describe 
the limit of H n , we need to incorporate the limit of G n into the data, and this is achieved by the 
three extra coordinates. Indeed, the limit of H n is the 3-uniform hypergraphon with value 1 on 
[0, l] 3 x [0, 1/2] 3 and elsewhere. Intuitively, while the first three coordinates encode the vertex 
types, the last three coordinates encode the vertex-pair types. This hypergraphon is {0, l}-valued 
since it is deterministic once the vertex and vertex-pairs types are set. If we modify the sequence 
H n so that each triangle of G n is included as an edge of H n with some probability p independently, 
then the limiting hypergraphon would take the value p on [0, l] 3 x [0, 1/2] 3 and elsewhere. 

For fe-uniform hypergraphs, we can similarly impose some structure at each level, corresponding 
to j-subsets of vertices, for every 1 < j < k. This is why we need a coordinate for every proper 
subset of [k] in the description of hypergraph limits. 

Random hypergraph model. To further illustrate the involvement of the 2 k — 2 coordinates in 
a hypergraphon, let us review the associated random hypergraph model. 

Recall that if W : [0, l] 2 -> [0, 1] is a graphon, then we have the following natural random graph 
model G(n, W) on ft v6rticGS! choosG i.i.d. uniform X\ } X2 5 • • • 5 x n € [0,1], and let there be an edge 
between vertices i and j with probability W(xi,Xj) independently. It was shown (9[ Cor. 2.6] using 
Azuma's inequality that G(n, W) converges to the limit W almost surely. 

Similarly, a fc-uniform hypergraphon W gives a natural model G(n, W) of a random ^-uniform 
hypergraph on n vertices: choose a uniformly random ~X- r ([n],k-i) £ [0, l] r ([ n ]' fe ~ 1 ) and add the edge 
B = {ii, . . . ,ik} C [n] with probability W(x r< ^)) independently. Essentially the same proof for 
graphs carry over to show [H Thm. 11] that G(n, W) converges to W as n — > oo with probability 
one. The random hypergraphs H n from the previous paragraph arise from this model. 

Analytic version and compactness. It will be convenient to prove an analytic version of Theo- 
rem ll.4[ We say that a sequence of A:-uniform hypergraphons W\, W2, . . . converges if t(F, W\), t(F, W2), ■ ■ ■ 
converges for every fc-uniform hypergraph F. 

Theorem 1.5. For every convergent sequence of k-uniform hypergraphons Wi, W2, ■ ■ ■ , there exists 
a k-uniform hypergraphon W so that t(F, W n ) — > t(F, W) as n — >■ 00 for every k-uniform hypergraph 
F. 

We prove Theorem 11.51 by induction on k. In fact we prove a colored generalization of The- 
orem 11.51 stated in Jj3j The generalization is motivated by the need for a stronger induction 
hypothesis for proving Theorem 11.51 A similar notion for graphs was considered in [8]. 

There is a neat interpretation of Theorem 11.51 in terms of compactness, following Lovasz and 

Szegedy [10] . Let Wq denote the set of fc-uniform hypergraphons. Give Wq be the weakest 

topology for which the functions t(F, •) are continuous for every /c-uniform hypergraph F. Identify 

W with W' if t(F, W) = t(F, W') for every fe-uniform hypergraph F. Call this topology the left- 
Ik) 

convergence topology of Wq . 

(k) 

Corollary 1.6. The space W y ' with the left -convergence topology is compact. 



-1 
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Proof. The space is metrizable with the metric 6(W,W) = ^2 i>t 2~ % \t(Fi,W) — t(Fi,W')\ where 
{Fi)i is some enumeration of all isomorphism classes of fc-uniform hypergraphs. We know that 
compactness is equivalent to sequential compactness in metric spaces. For any sequence W±, W2, ■ ■ ■ , 
by sequential compactness of [0, 1] N we can find a subseqeuence W ni ,W n2 , ... so that t(F,W ni ) 

converges as i —> 00 for every F. By Theorem 11.51 there is some limit W G Wft , thereby proving 
sequential compactness. ■ 

When k = 2, Lovasz and Szegedy [10] showed that Wq is compact under the cut metric topology, 
and Borgs, Chayes, Lovasz, Sos, and Vesztergombi [lj showed that the cut metric topology is 
equivalent to the left-convergence topology. Lovasz and Szegedy interpreted the compactness with 
respect to the cut metric as an analytic form of the regularity lemma, and they showed that 
the compactness of the space of graphons easily implies strong versions of the regularity lemma. 
Unfortunately, for k > 3, we do not know of a useful extension of the cut metric to hypergraphs 
(and there are some reasons to believe that such a natural metric might be too much to ask for), 
and this remains one of the main difficulties in working with convergence and limits of hypergraphs. 
An interesting open direction is to describe a natural and useful description of the distance between 
two hypergraphs that would give rise to the same topology on the space of hypergraphons as the 
one induced by homomorphism densities. The work of Elek and Szegedy |4j as well as the proof 
given in this paper offer some hints at the underlying topology of the space of hypergraphons, but 
it seems difficult at the moment to give a clean formulation of our understanding. 

Organization. In $2] we review Lovasz and Szegedy's proof and then sketch the idea of our ex- 
tension. The details are in £j3l 

2. Proof idea 

The cut norm is crucial to the study of graph limits. For any symmetric measurable function 
W: [0, l] 2 ->• R, the cut norm is defined by 

||W|| n := sup 

S,TC[0,1] 

where S and T range over all measurable subsets of [0, 1]. We have the identity 

||W|| n = sup 

u,v. [o,l]->-[o,i] 

where u and v range over all measurable functions [0, 1] — > [0, 1]. 

Recall that a graphon is a symmetric measur able function W : [0, l] 2 -> [0, 1]. For any measure 
preserving bijection (f>: [0, 1] — > [0, 1] and any graphon W, define by W^(x,y) = W(4>(x), <fi(y)). 
We define the cut distance between graphons by 

5 n {U,W) = inf||i7* - W\\a, 

<t> 

where the infimum is taken over all measure preserving bijections cj>: [0, 1] — > [0, 1]. The cut distance 
can be defined for pairs of graphs by considering their associated graphons, although we will stick 
with the analytic language here. 

The following counting lemma tells us that graphs that are close in cut distance share similar 
subgraph statistics. We review the proof as we will need an extension to hypergraphs. 

Lemma 2.1 (Counting lemma). For any graphons U and W and any graph F, we have 

\t(F,U) - t(F,W)\ < \E(F)\5 n (U,W). 



SxT 



W(x, y) dxdy 



u(x)W(x,y)v(y) dxdy 



(2.1) 
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Proof. It suffices to show that \t(F,U) -t{F,W)\ < \E(F)\ \\U -W\\ D since t(F,U) = t(F,U^). 
Let n = |V(.F)| and E(F) = *2j2, • • • ,imjm}- Write as a telescoping sum 

t(F, U) - t(F, W) 



„ / m m 

/ n^(zi.,^ e )-ijw( 

Ve=l e=l 
m „ \ I m 

\X\ u ( x i^ x ie) ) {U(xi,Xj) -W( Xi Xj )) I Yl W(x ie , 

U J ^ n \e=\ J \e=f+l 



x je ) ] dxi ■ ■ ■ dx n 

I m 

Xj e ) | dxi ■ ■ ■ dx n . 



/=1"L^J \e=l / \e=f+l 

Every term in the final sum is bounded by \\U — W\\rj. Indeed, for the f-th term, if we fix 
all variables except Xi } and Xj f , then we have an expression of the form Jj ^ 2 (U(xi f , Xj f ) — 
W(xi f , Xj f ))u(xi f )v(xi f ) dxi f dxj f for some functions u and v, and we can bound it using (|2.ip , ■ 

For any graphon W and any partition V of [0, 1] into a finite set of measurable subsets, let W-p 
be the step function graphon obtained by W by replacing its value at (x,y) S Pi x Pj, for any 
Pi,Pj £ V, by the average of W over Pi x Pj (if either Pi or has measure zero, then assign the 
value of W-p on Pi x Pj arbitrarily). 

An important tool in the construction of graph limits is the following weak regularity lemma 
due to Frieze and Kannan [5] (see also [TOj, Lem 3.1]). It can be proved by a mean-squared-density 
increment argument. 

Lemma 2.2 (Weak regularity lemma). For every e > and every symmetric measurable func- 
tion W: [0, l] 2 — > [0,1], there is some partition V of [0,1] into at most 2 2//e parts such that 
\\W-W v \\ D <e. 

Lovasz and Szegedy [10] showed that with respect to the cut metric, after identifying graphons 
with cut distance zero, the space of all graphons is compact. Equivalently: 

Theorem 2.3 (Lovasz and Szegedy [10]). Every sequence Wi,W2,... of graphons contains a 
subsequence converging to some graphon W in cut distance. 

Let us recall the idea of the proof of Theorem l2.31 Let e > 0, and apply the weak regularity lemma 
to approximate every W n by a step function with a bounded number of steps. By replacing each 
W n by some Wn, we may assume that the partition V n divides [0, 1] into intervals. We may now 
take a subsequence so that the lengths of the intervals converge, and the values of {W n )p n inside the 
boxes induced by the partition converge, i.e., the value inside the (i,j)-th box of (W n )-p n converge 
to some value as n — > oo (may be different limits for different Then in this subsequence, 

(W n )j> n converges pointwise almost everywhere to some limit U\, which is also a step function. 

Now repeat the same procedure with a smaller e' < e. We obtain new partitions V' n which 
are refinements of previous partitions. Call the resulting limit Ui. Note that steps of (W n )pi are 
refinements of the steps of (W n )-p n , and the values of the latter can be obtained from by the former 
averaging over each step. Thus a similar relation holds for U2 and U\. 

Now we repeat this procedure for a sequence of £/% tending to zero. We obtain a sequence 
Ui,U2,--. of step functions so that each U s can be obtained from Ut, t > s, by average over 
each step. It follows that if (X,Y) is a uniform random point in [0, l] 2 , then the sequence 
(U\(X, Y), U2(X, Y), . . . ) is a martingale. Since every U s is bounded, the Martingale Convergence 
Theorerdj (see |13l Thm. 11.5]) implies that the martingale converges with probability 1, and hence 
there is some U: [0, l] 2 — > [0, 1] which is the pointwise almost everywhere limit of the f7 s 's. One 
then checks that U is the desired limit. 



^The Martingale Convergence Theorem says that every //-bounded martingale converges almost surely. Our 
martingales are actually bounded uniformly within [0, 1] 
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In summary, the above proof consists of two main steps: 

(1) For each error tolerance e, apply a weak regularity lemma to get a finite-dimensional ap- 
proximation of each graphon, and then take a subsequential limit. 

(2) For a decreasing sequence of e, these limits form a martingale, so the existence of the limit 
as e — > follows by Martingale Convergence Theorem. 

Our construction of hyper graphons follows the same steps. For the first step, we need an extension 
of the cut norm. 

Definition 2.4 (Higher cut norm). For any symmetric measurable function W: [0,l] r< ^" — >■ R, 
define the (k — \)-cut norm to be 



sup 

si,...,s fc c[o,ir ([fc " 1]) 

symmetric measurable 



n<=l 7r r([)b]\{<})(^) 



sup 

ui,...,u k : [0,l] r([fc_11) -»-[0,l] 
symmetric measurable 



y[o,i] r <(W) " 



where 7r r ([fe]\{i}) is the projection of [0, l] r <(W) onto [0, l] r ([ fc l\W). 

The usual cut norm corresponds to the case k = 2. 

Example 2.5. For any symmetric measurable function W : [0, l] r< ^ 3 ^ — > M the 2-cut norm ||W|| n 2 
is defined by 



sup 



W(xi,X2,X 3 ,Xi2,Xi3,X23)ui(x2,X3,X23)u 2 {xi,X3, Xi 3 )w 3 (xi, X 2 , Xi 2 )dxidX2dx 3 dxi2dxi3dX23 
U,l]6 

r([2]) 



where u%, 112,113 vary over all symmetric measurable functions [0, l] r ^ 2 ^ — >• [0, 1]. 

For 3-uniform hypergraphs, this cut norm corresponds to edge-density deviations with respect 
to arbitrary vertex-pair subsets, as oppose to merely vertex subsets as was considered in the orig- 
inal Frieze-Kannan work 0. Similar notions were similar by Chung [3] in extending Szemeredi's 
regularity lemma to hypergraphs. 

This higher cut norm is only an intermediate step in the induction towards establishing the limits. 
It does not give the generalization of the cut distance asked for at the end of the introduction. 

The counting lemma, Lemma [2. 11 has a straightforward generalization with the same telescoping 
sum proof. A key observation is that every two edges of a /c-uniform hypergraph intersect in at 
most k — 1 vertices, so each term in the telescoping sum expansion of t(F,U) — t(F,W) can be 
bounded by the (k — l)-cut norm of the difference U — W. 

Lemma 2.6 (Counting lemma). For any k-uniform hypergraphons U and W and any k-uniform 
hypergraph F , we have 

\t(F,U)-t(F,W)\ < \E(F)\ \\U-W\\ nh -i 

Every symmetric partition V of [0, l] r u fc—1 l) (here symmetric means that every part is symmetric 
under any permutation of coordinates induced by a permutation of [k — 1]) induces a symmetric 
partition Tt*(V) of [0, l] r< (M) which is the minimal partition refining all ^([^{t})^) ^ or * = 1, ... , A;. 
Here ^ r ([k]\{i}) '■ [0, l] r< ^ -> [0, l] r ([ fc ]\W) i s the projection. For example, if k = 2 and V is a 
collection of intervals then 7r*(V) is a collection of boxes {J, x Ij}. In general, the cells 

of tt*(V) have the form fli=i 7r r"([fc]\{j})^*) where Si, . . . , vary over all /c-tuples of cells in the 
partition V. 
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For any A;-uniform hypergraphon W and symmetric partition V of [0, l] r ([ fe— ^\ define W-p to 
be the /c-uniform hypergraphon which is the step function obtained from W by replacing its value 
on each cell of tt*(V) by its value on the cell. It can alternatively be defined as the conditional 
expectation K[W \ tt*(V)]. The following weak regularity lemma follows from a straightforward 
extension of the energy increment argument used to prove Lemma 12.21 We will give a proof later 
of a colored generalization (Lemma [32 



Lemma 2.7 (Weak regularity lemma). For every e > and every k-uniform hypergraphon W there 
exists a symmetric partition V of [0, l] r ([ fc-1 l) into at most 2 k l e parts so that \\W — Wp\\ a h-i < £■ 

Now we sketch the construction of the limit hypergraphon. Start with a sequence W\, W2, ... of 
fc-uniform hypergraphons. For each e, we get a partition V n = {P n ,i, Pn,2, ■ ■ ■ ,Pn,e} of [0, l] r ([ fc_1 D 
regularizing each W n . Any symmetric measurable subset P C [0, l] r ([ fc_1 ]) can be associated to a 
{k — l)-hypergraphon W p by integrating out the top coordinate: 

W p (x r<m ) = [ l P (yL rm )dx [k] . (2.2) 
Jo 

Applying induction on k we can restrict to a subsequence so that W Pn > i converges to some (k — 1)- 
uniform hypergraphon Y % as n — > 00 for each 1 < i < I. Since V n is a partition, ^f =1 W Pn ^ = 1 for 
each i, so that Y17=i Y l = 1 as well. This allows us to create a new partition Voo = {-Poo,i, • • • , Poo,e} 
of [0, l] r (t fe - 1 D defined by 

i-l i ~\ 

Xr([fc-i]) : ^y J (x r<([fc _ 1 ] ) ) < x [fc _i] < ^y J (x r<([fc _i])) \ , i = 1,2,. ..,1. 
3=0 3=0 J 

(For i = £ the < should be changed to a <) Visually we are partitioning the cube [0, l] r ([ fc_1 l) by 
stacking up the hypergraphons Y 1 , . . . ,Y n along the x^-i] coordinat^. The partition Voo serves 
as a limit of V n . 

We can create a /c-uniform hypergraphon XJ\ which is a step function with steps vr*(7- , o) and 
values being the limiting values (restricting to subsequences if necessary) on the corresponding 
steps in (W n )-p n , just as in the Lovasz-Szegedy argument. 

We can repeat the same argument for a smaller e' < e and obtain a refinement V'^ of Voo, and 
a U2 such that U\ can be obtained from U2 by averaging over the steps. Continuing, we get a 
martingale U\, U2, ■ ■ ■ so that we can apply the Martingale Convergence Theorem to deduce the 
limit. 

In order to carefully handle the simultaneous convergence of W Pn ^ as n — > 00 for all 1 < i < I, 
we shall introduce in the next section hypergraphon-vectors and formulate a stronger induction 
hypothesis. 



3. Limits of hypergraphon-vectors 

In this section we prove a strengthening of Theorem 11.51 The strengthening is motivated by 
the need to have a stronger induction hypothesis in order to simultaneously handle a vector of 
hypergraphons. Define a k-uniform hypergraphon-vector to be a list W = (W 1 , W 2 , . . . ) of k- 
uniform hypergraphons (it may be indexed by any finite or countable set, but we use N as default). 

We need a "colored" version of homomorphism densities where each edge of a hypergraph F 
is embedded in a different hypergraphon. This is analogous to counting embeddings of F in a 



This is the point in the proof where the extra coordinates (e.g., the last three coordinates in a 3-uniform hyper- 
graphon) begin to play a role even if we start with a sequence of hypergraphs. More precisely, the limit Y l may not 
be {0, l}-valued even if each W n > 4 is. 
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multipartite hypergraph where each vertex of F is pre-assigned to a part. For every /c-uniform 
hypergraph F, hypergraphon- vector W, and map a: E(F) — > N, define 

t a (F,W):= [ 11 W a ^ A \ Xr<{A) ) dx^),^!). 

7[ ,l]r(V(F), fc -l) 

A counting lemma holds by a telescoping argument similar to Lemma l2.1i 

Lemma 3.1 (Counting lemma). For any k-uniform hypergraphon-vectors U and W, k-uniform 
hypergraph F and map a: E(F) — > N, if \\U l — W l \\ nk _ 1 < e for all i in the image of a, then 

\t a (F,V)-t a (F,W)\ < \E(F)\e. 

Proof. Let V = V(F) and n = \V\ and E(F) = {Ai, . . . , A m }. Write as a telescoping sum 

t a (F,U)-t a (F,W) 



I 



[ 0) l]r-(V,fc-l) 



e=l e=l / 



m r / f— 1 

^J[0,l]'-(v,fc-i) Ve=1 




a ^(x r<(Ae) ) dx. 



r(V,fc-l)- 

The /-th term is bounded by - W 01 ^]]^^ < e. Indeed, if we fix all variables other than 

x r K (A f ) then all the factors except for U a ( A f\x r< ( A )) — W^ a ^'( x r<(A/)) has the form u(x r ( B )) for 
some B <Z Af, where -B is the intersection of two edges, and hence the integral can be bounded by 
the (k — l)-cut norm. ■ 

We need to maintain partition and refinement relations of the parts of a partition. After applying 
(|2.2p . these relations become equations of the form ^ W Pj = 1 or W Pi . This motivates the following 
definition. For a /c-hypergraphon-vector W, a linear relation is defined to be an equation of the 
form CiW 1 = b where for some integer I and some real numbers ci, . . . , C£, b. The right-hand 

side denotes the constant hypergraphon with value b. 

Definition 3.2. A sequence Wi,W2,... of /c-uniform hypergraphon-vectors is said to converge 
to another k- uniform hypergraphon- vector (denoted W n — > W M ) if 

(a) t a (F,W n ) -+t a (F,W oo) as n — > oo for every /c-uniform hypergraph F and a: E(F) — > N; and 

(b) Every linear relation satisfied by all but finite many W n 's, n G N, is also satisfied by W^. 

Here is the main result of this section. 

Theorem 3.3. Every sequence Wi, W2, •• ■ of k-uniform hypergraphon-vectors contains a subse- 
quence that converges to some k-uniform hypergraphon-vector W^. 

Theorem 11.51 follows by taking each W n to be a single /c-uniform hypergraphon W n (either by 
restricting the index set to one element, repeating W n infinitely many times, or padding the rest 
of vector by 0). In Theorem [T3J any subsequential limit is the limit of the entire sequence since all 
the homomorphism densities are assumed to converge. 

Lemma 3.4 (Weak regularity lemma). Given k-uniform hypergraphons W 1 ,W 2 , . . . ,W m and a 
symmetric partition V of [0, l] r ([ fc-1 l) ; there exists a symmetric partition V' refining V into at most 
\V\ 2 km ^ 2 parts such that \\W l - Wp/|| nfc _i < e for each 1 <i<m. 
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Proof. We build the partition incrementally, starting with V . At at a given stage suppose the 
partition is Q. If ||W l — Tyg|| nfe _ 1 < e for every i then we stop. Otherwise there is some i and 
symmetric measurable subsets S\,...,Sk C [0, such that |E[ls(Wj — W»,q)]| > £> where 

S = C\j = i ^rdkWij})^^- New let Q' be the minimal partition refining Q and Si, . . . , Sp,. We have 



\w l Q >\\l = \\vr a \\l + ||w^ - w* Q \\l >\\ w h\\l + 



II ' \\ A 

The equality follows by Pythagorean Theorem, and the inequality follows from 1 1 Wq, — Wq || > 

(E[1s(Wq/ — Wq)]) 2 > e 2 . Since ||Wq|L < 1 for every i, this increment can occur at most m/e 2 
times. Each time we introduced at most k new sets into the partition, thereby increasing the number 
of parts by a factor of at most 2 k . Thus the final partition has at most \V\ 2 km / £ parts. ■ 

Remark. By allowing measure-zero parts, we can require that every part of V is refined into exactly 
\2 km / £2 ] parts. 

Proof of Theorem \3.3[ When k = 1, a A;-uniform hypergraphon is a just a value in [0, 1], so the 
result follows trivially by sequential compactness of [0, 1] N . Now we induct on k. 

Let e s = 1/s. For every s and n, apply Lemma 13.41 to find a symmetric partition V n ,s of 
[0, so that 

• [Pn,s\ = for some integer i s independent of n. 

• V ns +i is a refinement of V n ^ where every part of V ns is refined into an equal number of 
parts; 

• || - W^ s || nfc -i < £s for all n and all m < s, where W™ s := (W™)^; 

Let us arbitrarily order the parts of every partition while respecting refinement in the sense that if 
P comes before Q in V n ,s then every subset of P comes before every subset of Q in P„ )S+ i. Write 
P n ,s,j for the j-th part of V n;S - 

Consider (k — l)-uniform hypergraphons Yn ] '■= W Pn < s ^ as in ()2.2 j) . Collect the Y's into 
hypergraphon-vectors Y n = {Yn 3 )s,j indexed by {(s,j) € N x N : j < £ s }. These hypergraphon- 
vectors all satisfy the same linear relations arising from refinements, i.e., 

h jis+l/ia 

Y n j = 1 and Y n +1 ' f = Y n j s > 1 and 1 < j < i s . (3.1) 

i=i j'=0-l)4+i/4+i 

Using the induction hypothesis, we can replace (W n ) n >i by a subsequence so that (after rela- 
beling the subsequence as (W n ) n >i) 

• There is some (k — l)-uniform hypergraphon- vector Yoo = (YS ) a *• so that Y n converges 
to Yqo. 

• For every m < s and 1 < ji,---,jk < l s , the common value Wn,m,3,ji l ...,jk of W™ s on 
rii=i 7r rdfc]\{i})(- P "-sJi) converges to some value u; 00l m,sji,...j fc as n cx>. 

For each s, let Voo s = {-Poo s lj Poo s 2, • • • j -Poo s £ } be the symmetric partition of [0, l] 1 "^ -1 ]) defined 
by 

i-1 i 
Mk-l]) : E^^d*-!])) - ^-i] < y ^ J ( x r<([fc-i])) > , i = l,2,...,£. 



P 

1 oo,s,i 



j=0 j=0 



(when i = i change the < to a <) Visually we are forming a new partition of the cube [0, l] r ([ fc_1 l) 
by stacking Y^, ,Y^ 2 , . . . , Yoo a along the xy k _i\ coordinate direction. 

Next, construct a A;-uniform hypergraphon W™ s : [0, l] r< (M) — > [0,1] by setting it to have 
value Woo,m,s,n,...,j k on r\i=i^rak]\{i})^ P °°' s ^- Construct A;-uniform hypergraphon-vectors W njS = 



10 YUFEI ZHAO 

(W™ s )m for n G N U {oo}. By Lemma 13.51 we have for every s 

t a (F,W n , s ) -^ta^Woo,,), asn^oo. (3.2) 

For each s, let £> s denote the cr-algebra on [0, l] r <([ fc ]) generated by 7r*(7- , o,s) (see definition 
before Lemma I2.7P Then B s C £> s+ i since Poo.s+i is a refinement of "Poo,s for every s, as the linear 
relations (|3.1|) of Y n corresponding to partitions and refinements are preserved in the limit. 

Let X be a uniform random point of [0, l] r <(M). Then W™ s is a ^-measurable random variable. 
Since W™ s can be obtained from W™ s+l by averaging over the steps, the same holds in the limit 
(we defer a more detailed justification until the end): 

nw™ 3+1 | B 8 ] = W™ s . (3.3) 

It follows that for each m, (W™-^, W™ 2 , • • • ) is a martingale relative to the filtration (Bi,B2, ■■■)■ 
Since W££ s is bounded by 1 everywhere, it follows by Martingale Convergence Theorem that the 
martingale converges almost surely. Thus there is some hypergraphon W™ for every m > 1 so that 

W™ s — > W™ pointwise almost everywhere as s — > oo. (3.4) 

Let Wqo = (W£Z)m,. Any linear relation satisfied by W n is preserved at each step of the operation 
and thus holds in the limit. For any fc-uniform hypergraph F and a: E(F) — > N, we have 

ItaC^Wn) -taC^, Woo)| 

< \ta(F,W n ) -t a (F,W n , s )\ + \ta(F,W n , a ) -taC^Woo,,)! + \t a (F, Woo )S ) - t a (F, W^) | 

< \E(F)\s s + \t a (F,W n , s )-t a (^Woo)!. 
Taking limsup as n — > oo and using (13. 2p yields 

limsup|t Q (F,W n )| < | J B(F)|e s + |t a (F,W 00iS )-t Q (F,W 00 )|. 

n— >oo 

Let s — > oo and it follows by (|3.4p that t Q (.F, W n ) — > ^(i 7 , W^) as n — )• oo. ■ 

Lemma 3.5. Let Vi,V%, ■ ■ ■ ,Voo each be an ordered symmetric partitions of [0, l] r ([ fc-1 l) into £ 
parts and let Y n = (Y£ = W Pn ' j : j = 1, . . . ,£), n £ N U {oo}, be the corresponding (k — 1)- 
uniform hypergraphon-vectors. Assume that Y n converges to Yqo. Let Wi, W2, • • • , Woo oe k- 
uniform hypergraphon-vectors so that every hypergraphon in W„ is a step function that is piecewise 
constant on cells of ir*(V n ) (see definition before Lemma \2.7\ ). Furthermore, assume that for all 
m, as n — > oo, the common values of W™ on each cell ofn*(V n ) converge to the common values 
ofW™ on the corresponding cells o/7r*('P 00 ). Then for any k-uniform hypergraph F and any map 
a: E(F) — > N we have t a (F,W n ) ->■ t a (F, W^) as n -> 00. 

Proof. We are given that every W™, n£NU {00}, can be written as 

1 k 

W™( x r< ([*])) = w n,mJi r ..J k Yl 1 P n j i (^(M\{i})) dx r<([k])- ( 3 - 5 ) 

Ji,—,Jfc=l »=1 

where MJ n ,mji,...j t are the common values of W™ on the cells of ir*(V n ). When we expand 
t a (F,W n )= [ TT VC (A) (x, <( A)) <&r(v(F),k-i)- 
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using (|3.5p we can write t a (F, W n ) as a sum of terms of the form 



w n,* II 1p„j„ (*»•(£)) ^ x r(y(F),fe-l) 

/ FI y n S ( x r<(B)) *<t(V(F),*-2). (3-6) 



-BS-Bfc-i(-F) 

, [o,i] r ( l/ ( F ). fc - 2 ) 



SGi? fe _i(F) 

where Ek_\{F) denotes the set of all size k — 1 subsets of ^(i 7 ) that is contained in some edge of 
F, and w n ^ is the product of some combination of u> njmjli ... ) , ;fc 's. The second line comes from the 
first by integrating out all the variables xb with \B\ = k — 1. A key point here is that the sets 
P n ,i, ■ ■ ■ ,P n ,£ are disjoint, so that in every nonzero term in the expansion, each B € Ek_i(F) is 
associated to exactly one lp . , even if B is contained in several edges of F. 

It remains to show that (|3.6[) converges to the correct limit as n — > oo. We are given that 
w n ,m,j 1 ,...,j k — > Woo,mji,...j t as n — )■ oo. The remaining integral converges since Y n — > Yoo. ■ 



Proof of (|3.3p . Fix s and 1 < j\ , . . . , jk < l s , and for each 1 < i < k let J« denote the set of indices 
so that {P njS+ ij : j 6 Jj} is a partition of P n ,s,ji for every re € N U {oo}. Then (|3.3p amounts to 
the claim that 



L 



™n,m,s+l,j> v ...,j' h II lp n , s +lJ>. (*r([k]\{i})) <&r<([fc]) 



= / %,m, S Ji,...A [] lp ".»J, ( X KW\{«})) ^(H) ( 3 - 7 ) 

holds when n = oo. We know that (|3.7p holds for every finite n since V n , s +i is a refinement of V n ^ s 
and the w W;ntS; j lr „ t j k 's are just the average values of W™ on the cells of Tr*(V n ,s)- It remains to 
show that both sides of (|3.7p individually converge to the re = oo limit as re — > oo. 

By integrating out the variables x^n^}, 1 < i < k, the right-hand side of (|3.7p . for instance, 
becomes 

/ Wn,m,s,j u ...,j k T\ Y n M i*r -<([fc]\{i})) <&r([fc] ,fc-2) = W n>ms>jl j k t a (K k k 1} ,Y n ) 



j=l 



where a sends the edge [/c] \ {i} to the index (s,ji). The limit at n = oo follows from Y n — >■ Y 
and u>n,m,sji,...j fc — ^ ^oo,m,sji,...j fc . The limit for the left-hand side of (|3.7p is similar. ■ 
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